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ABSTRACT 

A study investigated the effectiveness of the Chapter 
1 Reading Program, which provided assistance to 5,956 selected 
underachieving pupils in grades one through eight in the Columbus, 
Ohio public schools* The program featured small group instruction 
arranged according to pupil needs for the improvement of language and 
reading skills. Data included results of norm-referenced tests 
administered in a spring-to-spring cycle. Results indicated that: (1) 
of the 1,896 grade 2-8 pupils in an evaluation sample, 58.6V. gained 
3.0 or more NCE points on the reading comprehension score; (2) total 
reading scores for a sample of 1,871 pupils in grades 2-8 increased 
an average of 4.9 NCE points; (3) of 1,909 first-grade and 
second-grade pupils, 1,557 (81.6^0 read five books at or above text 
reading level 8 appropriate for promotion to the next grade; (4) of 
1,896 pupils, 92.67. were promoted to the next grade or passed their 
target reading courses; and (5) 5,779 parents of pupils served were 
involved in one or more parent involvement activities, and that 77.4/1 
of pupils served had one or more parents who were involved. Findings 
-suggest the program should be continued; reasons for the small sample 
size should be determined and ameliorated if possible; the strong 
.support system should continue; and planning should take place at the 
building level. (Contains 9 references and 11 tables of data are 
included; 2 tables of data and evaluation instruments ar? attached.) 
(RS) 
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Elementary and Secondary Education Act-Chapter 1 

FINAL EVALUATION REPORT 
LANGUAGE DEVELOPMENT COMPONENT 
CHAPTER 1 READING PROGRAM 
1992-93 

Abstract 

ProQfann Description: The Chapter 1 Reading Program served 5956 pupils. Funding of the component 
was made available through the Elementary and Secondary Educatfon Act-Chapter 1 of Title I of 1965, 
reauthorized by the Hawkins-Stafford Elementary and Secondary School Improvement Amendment of 
1988. 

The purpose of the Chapter 1 Reading Program was to provide assistance to selected underachieving 
pupils in grades 1 through 8 in order that they might attain more fully their potential by improving their 
language and reading skills. The program featured small group instarctton arranged according to pupil 
needs, as determined by continued cooperatton between the program teacher and the classroom teacher. 
Inservfce sessions were provided for various subgroups of program teachers. 

The program provided service to 85 pubirc elementary schools, 28 publfc mkkJIe schools, and 12 ix>npublfc 
schools. One elementary school's program service {included in count above) was funded by the school 
system's general fund, but Chapter 1 guidelines were foitowed in all teaching units. Because public scfK)0l 
program teachers were funded 90% by Chapter 1 funds and 10% by the school district*s general fund, they 
were called Chapter 1 Consulting Teachers. Several different sen/rce pattems were devised in order to 
schedule Chapter 1 instruction for 90% of the teacher's tiiDe. Program teachers in the nonpubfc schools 
served as full-time Chapter 1 teachers. 

Time inten/al: For evaluatfon purposes, the program started on September 21, 1992, for ail grades. For 
evaluatton based on standardized test data the time intarval ended March 26, 1993. This provkled a 
maximum of 118 days for grades 1-8. An additional 25 school days {through May 7, 1993) were included in 
the time inten/al for evaluating Desired Outcomes not based on standardized test data. Each Desired 
Outcome had a pupil attendance criterion of attending 80% of scheduled program days for incluston in the 
sample or treatment group. 

Actrvities : Program teachers provided small group instmction to strengthen reading skills. Consultatfon 
with classroom teachers and parents was emphasized in order to provkle for indivklual pupil needs. 

Desired Outcomes: Desired Outcome 1 stated that at least 50% of the pupils (grades 2-8) in the evaluation 
sarTiple-those who met the attendance criterion or were discontinued, were English-speaking, and had a 
valid pretestiX>sttest score for Reading Con^prehension {advanced)-wouW gain at least 3.0 Nomial Cun/e 
Equivalent (NCE) points for the instmctional period. Desired Outcome 2 stated that at least 75% of pupils 
who met the treatment group attendance criterion would be pronnoted to the next grade {grades 1 -5) or pass 
their regular reading courses {grades 6-8). Desired Outcome 3 stated that at least 50 percent of the pupils 
in grade 1 woukl read at least five books at level 8 or above as certified by Chapter 1 teacher, and that at 
least 50 percent of the pupils in grades 2 and above in the treatment group who were ^x>t discontinued 
would independently read a minimum of ten books selected by the Chapter 1 teacher. 

Evaluatton Design: The Evaluation Design included the Desired Outcomes stated above and the 
instmments used to measure them. Desired Outcorr>e 1 was evaluated through the administration of nomv 
referenced tests in a spring-to-spring testing cycle. The Metropolitan Achievement Tests, Sixth Edition 
(MATS), were used for grades 1 and 2. Grades 3-8 received the California Achievement Tests {CAT, 1985) 
in the spring of 1992 and in the spring of 1993. Analyses of the pretest to posttest data were primarily in 
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terms of NCE change scores, using two different types of presantation: (1) the percentages of pupils by 
grade who had a change score in Reading Comprehension of at least 3.0 NCEs, which was the criterion for 
Desired Outcome 1 , and (2) aggregate NCE change scores, which were compared with Federal and State 
Guidelines. Federal and State Guidelines require an aggregate gain of at least 1 .0 NCE in both Reading 
Comprehension and Total Reading at the building level. Desired CXitcomes 2 and 3 were evaluated by 
means of locally constmcted instalments and/or the district computer files. Although not part of the 
evaluation desic^. parent involvement infomfiation was also collected by program teachers. 

Major Rndinos: The information collected on the Pupil Data Sheets indicated the program served 5956 
public and nonpublic pupils for an average of 3.4 hours of instmction per week. The average daily 
membership in the program was 4653.35 pupils. The average days of enrollment (days scheduled) per 
pupil was 103.4 days and the average attendance (days served) per pupil was 85.4 days. 

Desired Outcome 1, that at least 50 percent of pupils (grades 2-8) in the evaluation sample gain 3.0 or 
more NCE points on the Reading Comprehension score (advanced skills), was attained. Of the 1896 
pupils in the sample, 58.6% (1111 pupils) made the requisite gain. The average gain for Reading 
Comprehension across grades was 6.3 NCE points. At the individual grade level, all grades except grade 
3, grade 6, and grade 8 met the criterion of 50 percent of pupils gaining 3.0 or more NCE points. 

Additional analyses of aggregate achievement scores for Total Reading (basic skills) for grades 2-8 
showed that for the evaluation sample of 1871 pupils the average gain score across grades was 4.9 NCE 
points. Positive changes ranged from 8.2 NCEs in grade 5 to 1 .2 NCEs in grade 6. 

Desired Outcome 2 was that at least 75 percent of pupils meeting the treatment group attendance criterion 
would be promoted to the next grade (grades 1 -5) or pass their regular reading courses (grades 6-8). This 
Desired Outcome was met at every grade level. Of the 1896 pupils in this treatment group 92.6% (1755 
pupils) were promoted or passed their target courses. 

Desired Outcome 3 stated that at least 50 percent of grade 1 treatment group pupils wouW read five books 
at or above text reading level 8 as certified by the Chapter 1 teacher and that at least 50 percent of grade 2 
and above treatment group pupils, who were not discontinued, wouki indef^endently read "a minimum of ten 
books selected by the Chapter 1 teacher. This Desired Outcome was met at every grade. Of the 1909 
pupils in the treatment group, 1 557 (81 .6%) of the pupils read the requisite number of books for their grade. 

Parent involvement data indicated that an unduplicated count of 5779 parents of pupils served were 
involved in one or vnore parent involvement activities, and that 77.4% of pupils served had one or more 
parents who were involved. 

Process evaluatton was conducted to monitor the record-keeping procedures of teachers. Telephone 
conferences, on-site visitation, and inspections of records were instrumental in assuring accuracy. 

Recommendations: The following recommendations were made: (1) the program shouU be continued; (2) 
since only 1941 pupils of the 5956 program pupils served in grades 1-8 were included in the treatnrient 
group, ways to improve attendance should be studied; (3) continue the strong support system provkled by 
program administrators and coordinators; (4) Department of Program Evaluatton shoukJ continue 
HDonitoring of record keeping and data collectfon; and (5) plan at the building level to insure time for joint 
planning between program and classroom teachers. 
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Elementary and Secondary Education Act--Chapter 1 

FINAL EVALUATION REPORT 
LANGUAGE DEVELOPMENT COMPONENT 
CHAPTER 1 READING PROGRAM 

1992-93 

Program Description 

The Chapter t Reading Program served 5956 pupils. Funding of the component was made available 
through the Elementary and Secondary Education Act--Chapter 1 of Title I of 1965, reauthorized by the 
Hawkins-Stafford Elementary and Secondary School Improvement Amendments of 1988. 

The primary goal of the ESEA Chapter 1 Reading Programs was to help public and nonpublic 
students to become successful readers and learners at their grade levels (Policy Guide and Handbook tor 
ESEA Chapter 1 Programs, 1992: Conpiled by the Department of Competency Based Education, Federal 
and State Programs). This goal was two-pronged. The goal was to be accomplished by program teachers 
who were to provide two major services; supplementary instaiction to selected students experierKing 
difficulty in reading and writing in their regular classroom setting and opportunities for parent involvement 
through conferences, group meetings, classroom visits and progress reports. 

The first target of the goal, provide supplementary instmction, stated that the supplementary instajctlon 
was to support the classroom instruction and to focus on the individual needs of public and nonpublic 
students who were Identified for service. Nonpublic pupils in nonpublic schools, which qualified for Chapter 
1 service, received instruction in mobile classroom units which travelled to the school sites. Specific 
support was provided to both public and nonpublic students by reinforcing the reading and writing 
strategies/activities of the regular classroom and/or providing theme-related materials whenever pc visible. 

Instmctional Expectations, as delineated in the Policy Guide and Handbook tor ESEA Chapter 1 
Programs (Summer 1992), stated that each teacher's program was to be structured so that a visitor should 
observe the following facets: 

1. Learning Environment: Teacher had created a literature environment and a positive and 
purposeful classroom climate. 

2. Support Materials: Teacher used support materials which revealed a well-organized and 
focused instmctional program. 

3. Instructional Expectations: Teacher had developed a well-organized and focused instructional 
program which incorporated reading and writing of whole text, rereading of familiar text, and other 
instructional activities to meet individual needs. 

4. Required Documentation: Teacher adhered to Chapter 1 guidelines. 

The facet. "Required Documentation: Teacher Adhered to Chapter 1 Guidelines^" dealt with 
maintaining up-to-date student selection information on the selection printout and cun-ent sekK:tion test 
information; attendance records; posted class schedules and weekly schedules; records o( ongoing 
coordination meetings; and parent involvement records. All of these records were used to monitor tt^ 
program throughout the year by the Department of Program Evaluation and by the Federal and State 
Programs personnel. Monitoring of the other Instmctional Expectations was assumed by Federal and State 
Programs instmctional personnel. The second target of the goal was that teachers piovide opportunities for 
parent involvement through conferences, group meetings, classroom visits and progress reports since 
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parent involvement was considered essential to the goal of helping students to become successful readers 
and learners at their grade levels. Records were kept for number of contacts between program teachers 
and parents. These data were reported to the appropriate nnonitoring personnel. 

The Chapter 1 Reading Program was staffed by 166 {unduplicated count) public and nonpublic 
teachers serving in 172 program units in 125 schools. One general fund teacher and her school were 
included in this census. Of the 125 schools with program units, 113 were in public schools and 12 were in 
Chapter 1 eligible nonpublic schools. Of the 1 13 public schools, 85 were elementary and 28 were middle. 
The Nonpublic Project served grades 1-8. Of the 166 teachers in the total program. 109 were public 
elementary school teachers (including the one general fund teacher). 48 were public tvkkile school 
teachers, and 9 were nonpublic school teachers. Since sowe teachers were assigned to two schools, the 
166 teachers taught in a total of 172 program units. Of these. 1 1 1 program units were in public elementary 
schools (including the general fund program unit), 49 units were in public middle schools, and 12 program 
units were in the Nonpublic Project schools (grades 1-8). 

Fifty-nine (an unduplicated count) of the 166 Chapter 1 Reading Program teachers were combinatton 
teachers, i.e.. Combos. For this report, to be considered a Combo teacher, the teacher had to be assigned 
both reading and mathematics at the same school. For definition puiposes, teaching niathematics at one 
school and reading at another site made the teacher a half-time reading or a half-time mathennatlcs teacher 
(not a Combo). Combos served in both the reading program and in the mathematics program at the same 
school. Evaluation of the mathematics program is reported separately (Gibbons, 1994). 

Chapter 1 public school program teachers (both elementary and middle school) were funded 90 
percent by Chapter 1 funds and 10 percent by the distrk:i*s general fund. They were called Chapter 1 
Consulting Teachers. According to Federal and State Program guidelines for implementing the Chapter 1 
Reading Program, the public elementary and middle school, full-time Chapter 1 Consulting Teachers were 
to provide instruction to a maximum of 36 pupils (half-time teachers 18 pupils) during the day, nine times 
during a two-week cycle, for a minimum of 40-60 minutes per day. This was the prevailing pattern of 
service; however, other patterns were in evidence (Patterns of Servwe Delivery are discussed later in this 
report beginning on page 3). Instructton took place in regular classrooms or in rooms equipped as 
language laboratories. One .6 FTE general-fund teacher was assigned one school in this project. The 
general fund program unit represented an expansion of the Chapter 1 program. All Chapter 1 guidelines for 
this program unit was in effect. The data for this teacher's unit were subsumed in the elementary school 
data for this report. 

Chapter 1 Nonpublk; Project teachers (elementary and mkklle school) were funded 100 per cent by 
Chapter 1 funds and provided instructfon indivklually, or in groups of four or five, to pupils two-to-five times 
per week, for 45 minute periods. They provkJed sen/tee off church property in mobile classroom units. 
Because Nonpublk: Project teachers were Columbus school emptoyees and were part of the Chapter* 1 
Reading Program, they foltowed ESEA Chapter 1 guklelines.^ 

Pupils qualified for the program based on a Selectton Score (Grade 1) or a Servk^e Index Number 
(Grades 2-8). The Selectk)n Score used in Grade 1 was based on the scores from two diagnostk; reading 
and writing tests (Clay. 1979). The Servk^e Index Number used in grades 2-8 was based on a Total 
Reading Score adjusted for the pupiFs age-grade. Pupils were then selected for sen/k:e based on greatest 
need according to rank-order. 

The Chapter 1 Reading Program served a total of 5956 pupils. Of the 5956 total. 3864 pupils (grades 
1-5) were served in the publk; elementary school projects. 1855 pupils were sensed in the public n^le 
sctx)Ol project, and the Nonpublk; Project schools served 237 pupils in grades 1-8. 

A further breakdown of the pupil census showed that at the primary level (grades 1 -3), a total of 2726 
pubte and nonpublto school pupils received servk^e. At the interrDediate level (grades 4-5), a total of 1330 
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public and nonpublic school pupils received service; and at the middle school level, (grades 6-8) a total of 
1900 public and nonpublic school pupils were served. 



Evaluation Design 

Desired Outcomes 

Three Desired Outconr)es (perlormance objectives) to be achieved by program pupils were delineated 
for the Chapter 1 Reading Program as follows: 

Desired Outcome 1 : At least 50 percent of the pupils (grades 2-8) in the evaluation sample (those 
pupils who had valid pretest and posttest measures, were English-speaking, and attended the program at 
least 80 percent of the instructional period or were discontinued) will gain at least 3.0 normal curve 
equivalent (NCE) points for the instructional period in Heading Comprehension. Gain will be measured by 
a nationally standardized achievement test. Percentages of pupils in grades 2S who gained at least 3.0 
NCE in Reading Comprehension are reported in the findings section. 

Nomi-referenced test data for Reading Comprehension performance are reported for the grade 2-8 
sample as required in Desired Outcome 1 . In addKion, Federal and State Guidelines require that aggregate 
test data be reported for grades 2 and above for both Reading Comprehension and Total Reading for 
individual buildings. The criterion perfonrance level for the Federal and State Guidelines is an aggregate 
gain of at least 1.0 NCE in both Reading Comprehension and Total Reading at the building level. The 
overall aggregate NCE score for grades 2-8 are reported in the findings section of this report. Aggregate 
scores at the building level are available on request. 

Desired Outcome 2: Annually at least 75 percent of the pupils (grades 1-8) in the treatment group 
(those pupils who attended the program at least 80 percent of the instmctional period or were discontinued) 
will demonstrate satisfactory progress in the regular classroom as demonstrated by promotion to the next 
grade level at the elementary level or by passing the course in which reading instaiction occurs at the 
middle school level. At the middle school level only pupils who are enrolled in a reading course will be 
included. 

Desired Outcome 3: Of the grade 1 pupils in the treatment graip, at least 50 percent of the pupils will 
read at least live books at text reading level 8 or above as certified by the Chapter 1 teacher At least 50 
percent of the pupils in grade 2 and above in the treatment group who were not discontinued will 
independently read a minimum of ten books selected by the Chapter 1 teacher. 

Program Timelines and Patterns of Sen/ice Delivery 

Because all three Desired Outcomes defined the evaluatton sample or the treatnient group in tenns of 
pupils who satisfied attendance requirements for the instructional perioci* the feader shoukl be aware of the 
program timelines and the program teacher Patterns of Service Deliver/ in the Chapter 1 Reading Program. 

For evaluation purposes, the program time period for Desired Outcome 1 and for aggregate test 
scores required by Federal and State GukJelines was 1 18 days maximum beginning September 21 » 1992, 
and ending March 26, 1993. lor all grades and all projects. Analyses of pretvest-posttest perfonnance was 
contingent upon the pupils' meeting the attendance criterion for inclusk>n in tha evahiatton sample for this 
outcome. 

For pupils in grades 1-8. the program time period established for evaluating Desired Outcomes 2 and 
3 was 142 days maximum beginning September 21 , 1992 and ending May 7» 1993. Analyses of these two 
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outcomes were contingent upon pupils' meeting the attendance criterion delineated by the specific Desired 
Outcome. 

The program timelines were in effect for ail pupils except for those who were discontinued. To 
discontinue a pupil, the program teacher had to follow criteria set forth by FeJenal and State Programs. Any 
child discontinued following due process was automatically included in both treatment groups (regardless 
of their attendance). 

However, there were some variations in the maximum number of program days (amounting to a day or 
two more or less) for the nonpublic schools. This difference occun-ed when their schedules differed from 
the Columbus Public School scheduled vacation days, inservice days, parent conference days, and 
professional days. 

Public school Chapter 1 Consulting Teachers were funded 90 percent from Chapter 1 funds and 10 
percent from the district's General Fund. Nonpublic Project teachers were funded 100 percent from 
Chapter 1 funds. General Fund time was not used for Chapter 1 pupils. Because of this, the maximum 
number of scheduled days (enrollnrient) for pupils was dependent upon each teacher's Pattern of Sen/ice 
Delivery. Even though the program guidelines defined the program time period giving the maximum 
number of possible school session days, each teacher's pattem of sen^ice dictated how many days would 
be counted as scheduled days for pupils in that unit. 

There were four pattems of sen/ice delivery in effect. The general operating mle for public schod 
program teachers was for them to schedule 90% of the pupil week or day for compensatory instaiction. 
This was accomplished in several ways: 

0 Of the 172 program unit^, 61.67© (106 units) had pupils scheduled 90% of each cvcle of two 
weeks f or compensatory instruction, giving a 9 out of 10 day sen/ice pattem for each pupil. 

0 Of the 172 program units, 36.0% (62 units) had pupils scheduled 90% of each day for 
compensatory instruction, giving a 5-day sen/rce pattem for each pupil. 

0 Of the 172 program units, 1 .2% (2 units) had pupils schedulad for 60% of each week (equivalent 
to 3 days a week) and another 1.2% (2 units) had pupils scheduled for 40% of each week 
(equivalent to 2 days a week). These two service pattems reflect the fact that some teachers had 
assignments in two schools or in two programs, with their total Chapter 1 time distributed in two 
classroom units. 

Variations in sen/ice pattems created some complicattons during data analyses because inclusion in 
the evaluatton sample or treatment group of any desired outcome was tied to an attendance criterion of 
pupil attendance for 80 percent of the scheduled days of instiuctton. Data analyses incorporated these 
mixed pattems so that pupils were not kept out of the treatment group or the evakjatfon sample. 

Instruments 

The evaluation design required the collection of data in five areas of operatfon for the overall program: 
Pupil Census; Standardized Achievement Testing; Retainee/Course Failure; Number of Books Read; and 
Parent Involvement. Though not required for the evaluation design, data from selected insen/k:e meetings 
and process evaluatk)n were collected, analyzed, and reported to Federal and State Programs. Specifk; 
instruments are discussed below. Copies of instalments used to collect the data are found in Appeixiix B, 
with the exception of the standardized achievement tests and some variations of the inservice evaluatk>n 
form. Inservice evaluation fomns were adapted to fit specific insen/k;es. two examples of which are found in 
Appendix B. 
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1 . Pupil Census Instruments 



Calendar Worksheet for Recording Days of Pupil Attendance. The Calendar Worksheet was 
locally developed to help program teachers collect program scheduled/service data. A Calendar 
Worksheet was kept for each pupil. The form included the following infonnation: the pupirs 
name, birthdate. number, ethnic or race code, sex, grade level, and the Selectfon Score/Service 
Index Number. These forms were kept up-to-date by the program teachers so that correct 
information was available to report at the end of the year on the Pupil Data Sheet. These fomis 
were examined periodically for process evaluation. See page 32 of Appendix B for copy of form. 

Puoil Roster 1992-93. In February 1993, a computer-generated rosier of pupils sorted by 
program, school, teacher's social security number, and student name within grade was sent to 
program teachers. Program teachers checked all names of pupils enrolled and served during the 
1992-93 school year. If teachers taught in two or more compensatory programs, they completed 
a roster for each program (see page 33. Appendix B for a sample copy). 

Pupil Data Sheet. The Pupil Data Sheet was developed to help program teachers summarize the 
pupil information from the Calendar Wori<sheels and parent informatbn from the Parent 
Involvement Log at the end of year. This instrument was used to collect the foltowing infonmatton: 
identificatton of pupils who were English-speaking; subjective ratings of pupil progress given by 
teachers; the number of hours of instmction per week; kientificatfon of pupils who were 
discontinued; data on whether a parent helped with homework or read to chiW or vfce versa; an 
enumeration of five parent involvement activities; the number of books read; the number of days 
of service received: and lastly, the teacher's pattern of service. A copy of the instalment can be 
found on page 34 of Appendix B. 

2. Standardized Achievement Test Instruments 

Metropolitan Achievement Tests Sixth Edition (MATS. 1985). Rrst- and second-grade pupils 
were administered the Metrof)olitan Achievement Tests, Sixth edition (MAT6, 1985), which were 
published by the Psychotogical CorporattonyHarcourt Brace Jovanovich, Inc. This test series has 
two sets of nonrrs (national and nonpublic) for fall and spring. Standardization was established 
between October 1 and 31 in 1984 for fall, and spring standardization was established between 
April 8 and May 1 5 in 1985. Special testing of grade 3 program pupils occun'ed April 26-May 5, 
1993 as a posttest for grade 3 pupils who took the MATS in spring 1992 as their pretest as 
second-graders. 

California Achievement Tests (CAT. 1985) . The Calitomia Achievement Tests (CM, 1985) were 
administered to pro: "^m pupils in grades 3-8 in Spring 1992. This test series, which is also 
published by CTB/^lGU^aw-Hill, has empirical norms for fall and spring, established in the fall of 
1984 and the spring of 1985. 

All testing was done on level using the Nom>Referenced Model for evaluation of the Chapter 1 
Reading Prograni. A spring-to-spring testing cycle was used for grades 2-8. The form, subtest, and test 
levels used for each grade level are shown in Table 1 . 

The achievement tests were administered as follows: Pretests and posttests for grades 2-8 were 
administered as part of Districtwide Testing in Spring 1992 and Spring 1993. Pupils in grade 1 were also 
tested as part of Districtwkie Testing in Spring 1993 in order to establish pretest scores for the 1993-94 
school year. During Districtwkie Testing, tests were administered by classroom teachers with program 
teachers serving as proctors. Program teachers in the nonpublic schools (serving grades 1-8) foltowed the 
same testing schedule but administered their own pretests and posttests. 
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"^-^tainee/Course Failure Instmments 

District Retention Hie and Districl Grade Repoflino Rie. At the end of the year, infomiation 
regarding retention was obtained from the district retention file for public school elenientaiy pupils 
in grades 1-5. The course failure informatfon for mkWIe school pupils was obtained from the 
district grade reporting file for public school pupils in grades 6-8. This information was needed to 
detemiine the percentage of pupils meeting the criterion of Desired Outcome 2. 

Nonpublic End-of-Year Data Collection Fomi. A locally developed instmrDent, ^'onpublic End-of- 
Year Data Ccllectfon Form, was designed to collect tha Nonpublic Project (grades 1-8) 
retention/course failure data. This printout was a roster of pupi! names with spaces for marking 
whether or not an elementary pupil was retained or for recording the final grade received by a 
middle school pupil in reading. The retainee/course failure information for nonpublic schools was 
collected by program teachers and reported (via telephone) to the Department of Program 
Evaluation. A copy of the instrument can be fouixJ in Appendix B, page 35. 

4. Instalments for Recording Number of Books Read 

Locally developed instalments (Pupil Independent Reading Record Sheets) were constmcled to 
assist teachers in maintaining records and reporting data at the end of the year. However, these 
primary sources were not collected for auditing purposes by the Departnient of PiX)gram 
Evaluation. The reading record sheets were used by program teachers to maintain listi.vgs of 
books pupils had successfully completed. The final number of books read by each pupil was 
reported to the Department of Program Evaluation on the Pupil Data Sheet. (See page 34, 
Appendix B for a copy of the Pupil Data Sheet.) 

5. Parent Involvement Instalment 

Parent Involvement Loo. The Parent Involvement Log was a locally developed instmment 
designed to assist teachers in keeping a record of the number of parent contacts. Teachers were 
asked to collect data for two activities which couki occur at anytime during the year: whether the 
parent helped the chiW with homework and whether the parent read to the chiW or the child read 
to the parent. Teachers were also asked to record how many parents were involved in the 
following five activities: invoh/ennent in planning, attendance at group nfieetings. indivWual 
conferences, parental classroom visits, and home visits (see page 36, Appendix B). 

Pupil Data Sheet. This instalment, described eariier, was used by teachers to help summarize 
data from their Parent Involvement Logs. A copy can be found in Appendix B, page 34. 

As stated at the beginning of the Instmments seclton of this report, data for selected inservice 
meetings and prcx:ess evahiatton were collected, although not required by the evaluation design. Locally 
devetoped instmments were designed by Federal and State Programs in conjunction with the Department 
of Program Evaiuatton to obtain teacher perceptions regarding selected inservice sessions. The forms 
were administered to participants at the close of each formally evaluated inservice session. The insen^ice 
evaluation forms were usually adapted to fit specific inservices, but two representative exanples of 
inservice evaluation terms can be found on pages 37-39. Appendix B. While the design dkl not provWe for 
the collection of these data (nor are the findings reported here), interim insen^ice evaluation reports were 
forwarded to Federal and State Programs, where they are available on request. Dates and topics of the 
inservice meetings are shown in Table 2. 

A discussfon of the results from process evaluation, which was conducted periodfcally throughout the 
year, appears later in this report. 
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Major Findings 

Three Chapter 1 Reading Program projects served elementary (grades 1-5) and middle school pupifs 
(grades 6-8) in the public schools and grades 1-8 in the nonpublic schools. The Nonpublic Project (NP) and 
the public school project achievement data were generally aggregated as a single entity for reporting 
purposes in the results section of this report. The same Desired Outcomes were expected from both public 
and nonpublic projects. An overview of evaluation ^e^ults for the three Desired Outcomes is provided in 
Tables 10 and 11 on pages 23-24. 

Pupil Census Information 

A total of 5956 pupils, including 5719 pupils in public schools (grades 1-8) and 237 in nonpublic 
schools (grades 1-8). was served by the ESEA Chapter 1 Reading Program during the 1992-93 school 
year for an average of 3.4 hours of Instaictlon per week. Of the 5966 public and nonpublic school pupils, 
4056 were in grades 1 through 5 and 1900 pupils attended middle schools. Generally, the 237 nonpublic 
elementary and middle school pupils* enrollment and attendance data were subsumed in the public school 
data. 

The average daily membership in the overall program was 4653.35 pupils. The average days 
scheduled (enrollment) per pupil was 103.4 days, and the average days served (attendance) per pupil was 
84.5 days. Data pertaining to enrollnK^nt and attendance are presented in Tables. 

Pupil census information also included teachers' subjective ratings of pupil progress as pupils exited 
the program. Of the 5956 pupils served in the program 5955 were rated: 1 668 (28.0%) were rated by their 
program teachers as making much progress. 3696 (62.1%) as making some progress, and 591 (9.9%) as 
making no progress. 

Standardized Achievem e nt Test Information 

Program pupils were included in either or both of two evaluation samples. One was comprised of 
pupils who met the attendance criteria or were discontinued, were English speaking, and had a valid 
Reading Comprehension pretest and posttest score. The secor»d was comprised of pupils who met the 
attendance criteria or were discontinued, were English-speaking, and had a valid Total Reading pretest and 
posttest score. Some pupils might have met the criteria for only one evaluation sample. Nomo-referenced 
test data for Reading Comprehension are reported for grades 2-8 as required in Desired Outcome 1. In 
additton, Federal and State Gukieiines require that aggregate test data be reported for grades 2 and above 
for both Reading Comprehenston (Advanced Skills) and Total Reading (Basic Skills) for indrvWual 
buildings. Therefore. Total Reading test data for grades 2-8 are also reported in the Federal arxJ State 
Guidelines Infonmatton section. 

Of the 5956 pupils sen/ed. 52 (0.9%) were non-English speaking and 279 (4.7%) were eligible for 
Special Education. An addrtbnal 3729 were excluded from the Reading Comprehension analysis due to 
incomplete test d?ita and/or non-attainment of the attendance criterion. The final evaluation sample for the 
Reading Comprehenskjn analysis was comprised of the remaining 1896 pupils, whfch was 31.8% of the 
pupils served. The final evaluation sample for the Total Reading analysis was 1871 pupils, or 31 .4% of the 
pupils served. Excluded from the evaluatton sample for Total Reading were the 52 non-English speaking 
pupils as well as the Special Education pupils and an addrtk)nal 3754 pupils who had not attained the 
attendance criterion and/or had incomplete test data. 

Normal curve equivalents (NCEs) are generally conskJered to provkJe the tmest irKlication of pupil 
growth in achievement since they provkle comparative information in equal units of measurenf>ent. In the 
following narrative the Reading Comprehenston (Advanced) test results from the grade 2-8 evaluation 
sample used to measure Desired Outcome 1 attainnf^nt are discussed finst; and foltowing that discussion, 
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the Total Reading (Basic) test resuHs Irom the grade 2-8 evaluation sample used in aggregated data to 
fulfill Federal and State Guideline requirements are discussed. 

Desired Outcome 1 intomriatfon 

Desired Outcome 1 stated that at least 50 percent of the pupils (grades 2-8) in the evaluation sample 
will gain at least 3.0 normal cua^e equivalent (NCE) points for the instmctional period in reading 
comprehension. Gain will be measured by a nationally standardized achievement test. The following 
section discusses the result;^ of norm-referenced testing for Reading Comprehension for grades 2-8. 

Evaluation of reading comprehension performance. The grade 2-8 evaluation sample for Reading 
ConDprehension included a total of 1896 public and nonpublic school pupiis. Of the 1352 pupils in the 
elementary (grades 2-5 sample), 944 were in the primary groups and 408 were in the intermediate group. 
The middle school sample had a total of 544 pupils. 

Data for normal curve equivalents (NCEs) for the 1896 pupiis in the grade 2-8 evaluation sample for 
Reading Comprehension are presented in Table 4. To meet the desired outcome for advanced skills, at 
least 50% of the pupils had to gain at least 3.0 NCE points between pretest and posttest. Of the 1896 
pupils in the grade 2-8 evaluation sample, 1111 pupils, or 58.6% met this criterion change score. Thus 
Desired Outcon^ 1 was met for the overall program. The overall average gain for the program was 6.3 
NCE points. Average NCE gains for individual grades are included in Table 4 and range from 0.5 NCE In 
grade 8 to 1 0.4 NCE in grade 2. Individual grades meeting the criterion of 50 percent of pupils in evaluation 
sample gaining at least 3.0 NCE points were grade 2 (67.3% of sample, average NCE gain 10.4); grade 4 
(57.1% of sample, average NCE gain 4.8), grade 5 (77.2% of sample, average NCE gain 9.0); and grade 7 
(65.3% of sample, average NCE gain 8.6). The desired outcome was not tml at grade 3 (48.3% d sample, 
average NCE gain 3.7); grade 6 (47.8% of sample, average NCE gain 2.5); and at grade 8 (42.7% of 
sample, average NCE gain 0.5). 

It should be kept in mind that NCEs are based on percentiles which compare the pupil's performance 
in relation to the general population. For & pupil's NCE score to remain the same at posttest as at pretest 
does not denote a lack ct absolute progress; on the contrary, it means that the pupil has maintained the 
same relative position in terms of the genera! population. Even a small gain in NCEs indicates an 
advancement from the pupil's original level of achieverront. For readers interested in percentile statistics 
for Reading Comprehension, see Table A-1 in Appendix A (page 29). 

Federal and State Guidelines Information 

Because Federal and State Gukietinas require that aggregate test data be reported for grades 2 and 
above for both Reading (Comprehension (Advanced Skills) and for Total Reading (Basic Skills) for 
individual buildings. Total Reading test data for grades 2-8 are reported in the foltowing section as 
aggregated data. 

Evaluation of total reading perfonnance. A census of the grade 2-8 evaluation sample for Total 
Reading indicated a total of 1871 public and nonpublic school pupils. (Df the 1328 pupils in the elementary 
school (grades 2-5) evaluation sample, 921 were in the prinr^ry level and 407 were in the intemoediate 
level. The middle school evaluation sample had a total of 543 pupils. 

Q'erail results for normal curve equivalents tor the 1871 pupils in the grade 2-8 evaluation sample for 
Total Reading are presented in Table 5. Aggregate achievement scores for indivkJual buiWings were 
reported to the State of Ohio Department of Education. Division of Federal Assistance, and are available on 
request. For purposes of this report, only the average NCE scores for Total Reading by grade and total 
program are reported here. The overall average gain for the program was 4.9 NCE points. Positive 
changes occurred in ail grades with average gains as follows: 8.2 NCEs in grade 5, 6.4 NCEs in grade 7, 
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5.9 NCEs in grade 2, 5.1 NCEs in grade 4, 4.3 NCEs in grade 3, 1.8 NCEs in grade 8, and 1.2 NCEs in 
grade 6. For readers interested in percentile statistics, see Table A-2 in Appendix A {page 30). 

Basic and advanced skills aggregated scores for Federal and State Guidelines. According to Federal 
and State Guidelines school buildings will be designated for School Program Irnprovement in two ways: (1) 
when any Desired Outcome for the program is not met at the building level, or (2) when the aggregate NCE 
change score for the building is less than 1 .0 NCE in Advanced Skills (Reading Corrprehension) and/or 
Basic Skills {Total Reading ). Buildings in School Improvement are required to submit a plan to strengthen 
their program. 

Aggregate scores for individual buildings were reported to the State of Ohio Department of Education. 
Division of Assistance, and are available on request. For puiposes of this report, only summary data by 
grade are presented. Aggregate scores were reported earlier in this report for Reading Comprehension 
(Table 4) and Total Reading (Table 5). 

Table 6 presents program pupil performance in Advanced Skills and Basrc Skills dichotomized in 
relation to the state mandated criterion of 1 .0 NCE gain. As indicated in Table 6, 1211 pupils (63.9%) made 
gains of 1.0 or more NCE points in Advanced Skills (Reading Comprehension) and 1162 pupils (62.1%) 
made gains of 1 .0 or more NCE points in Basic Skills (Total Reading). 

Desired Outo me 2 Information 

Desired Outcome 2 stated that 75 percent of the pupils in the treatment group wouW be promoted to 
the next grade (grades 1-5) or pass their reading courses (grades 6-8). Infomiation for the public school 
and NP Chapter 1 Reading Program was collected at the end of the year. To d^enmlne the number and 
percent of public school pupils who were pronioted to the next grade or who passed their reading courses, 
the district retention file for grade 1-5 pupils and the district grade reporting file for grade pupils were 
used. 

Information for the nonpublic school Chapter 1 Reading Program was collected from program teachers 
via telephone and recorded on the Nonpublic End-of-Year Data Collection Form, a locally devetoped 
instalment. Program teachers consulted with each pupil's classroom teacher at the end of the year to 
detemiine which pupils were not promoted to the next grade in elementary or failed to pass reading at the 
middle school level. 

Retainee/course failure. Table 7 presents the Desired Outcome 2 results. Of t^^e 1896 pupils in the 
treatment group. 1755 (92.6%) were promoted to the next grade or passed their reading courses. In the 
elementary grades the percent of pupils who were pron[X)ted to the next grade ranged from 83.3% in grade 
1 to 97.2% in grade 4. In the mkldle school grades the percent of pupils who passed their reading courses 
ranged from Ji7.0% in grade 6 to 91 .5% in grade 8. The criterion for measuring Desired Outcome 2 was 
that 75 percent of the pupils in the treatment group would be pronwted to the next grade (elementary 
pupils) or pass their reading courses (middle school pupils). This criterion was exceeded at every grade 
lovel. Thus Desiried Outcome 2 was attained. 

Desired Outcome 3 Information 

Desired Outcooie 3 stated that of the grade 1 pupils in the treatment group, at least 50 percent of the 
pupils will read at least five books at text reading level 8 or above as certified by the Chapter 1 teacher. At 
least 50 percent of the pupils in grade 2 and above in the treatment group who were not discontinued will 
independently read a minimum of ten books selected by the Chapter 1 teacher. 

Information was collected by a kx:ally constructed instalment (Pupil Data Sheet) at the end of the year. 
Program teachers submitted summary information on the fomi. The resuf from the analysis for Desired 
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Outcome 3 showed that of 1909 pupils in the treatment group, 1557 (81.6%) of the pupils met the criterion 
of reading the requisite number of books for every grade level. See Table 8 for the results of the analysis 
by grade for Number of Books read. 

Text reading level. To meet the criterion on number and level of books reart for Desired Outcome 3, 
first-grade pupils had to read at least five books at or above text reading level 8. Of the 1S2 pupils served, 
66 first-grade pupils were in the treatment group. Of the 66 pupils in the treatment group, 57 pupils (86.4%) 
successfully completed reading five books at or above text reading level 8 as certified by the Chapter 1 
program teacher. 

Independent reading. The task criterion for Desired Outcome 3 for Grade 2 and above involved pupils' 
reading independently a minimum of ten books which were selected by the Chapter 1 program teacher. Of 
the 5794 pupils served in grades 2-8, 1843 pupils were in the treatment group. Of the 1843 pupils in the 
treatment group. 1500 pupils (81.4%) successfully completed reading independently ten books selected by 
the Chapter 1 program teacher. 

Tables 1 0 and 1 1 in the summary sectton of this report provWe an overview of the results of the three 
Desired Outcomes that were to be achieved by program pupils in the Chapter 1 Reading Program. 

Parent Involvement information 

Because parent involvement was considered essential to the goal of helping pupils become 
successful readers and leamers at their grade levels, data were collected on this aspect of the program 
even though parent involvement was not included in the evaluation of desired outconfies. Teachers 
recorded parent involvement activrties during the year on the Parent Invoh/ermnt Log {Appendix B, page 
36). The Pupil Data Sheet (Appendix B, page 34) was used to collect summary data from teachers at the 
end of the year concerning program activities involving parents o1 program chiklren. Parent Involvement 
data were analyzed in two ways: the number of pupils whose parents had participated in parent 
involvement activrties, and overall parent involvement in specific activities, reported for all pupils served 
during the year. 

Overall parent involvement. Analysis results of overall parent involvement in five activities are 
presented in Table 9. Indivkiual Conferences accounted for wore parent involvement (6273 parents) than 
any other activity. Yeariy totals for the other activities foltow: group meeting with parents (1447 parents 
involved); parent classroom visits (1093 parents involved); planning, (638 parents involved); and visits to 
parent homes by teacher (127 visits). Since a parent could have involvement in more than one activity, an 
unduplicated count of parents was obtained from program teachers at the end of the year using the Pljpil 
Data Sheet. This count indteated that for the 5956 pupils served, a total of 5779 parents of program pupils 
served were involved in one or more program involvement activities during the school year. Of the 5956 
pupils served, 4609 (77.4%) had from one to four adult members of their families involved in the above five 
activities. In addition to the five activities noted above, teachers also kept a record of two other activities: 
1) Parent helped with chikl's honiework and 2) Parent read to chikl or vice versa. Of the 5956 pupils 
served, 5002 (84.0%) had parents who helped their chiklren with homeworic and the parents of 4831 pupils 
(81 .1%) parents read to their chiklren or vrce versa. 

Process Evaluation Informatton 

Two methods were used to collect process evaluatbn infonmatk)n: auditing of pupils' 
scheduled/served days and parent involvement records, and on-site visitattons. 

Audit. Teachers kept a Calendar Worksheet for each pupil to record scheduled/served days and 
other pupil informatton. On the reverse skle of this instalment was the Parent Involvement Log whteh was 
used to record parent involvement information. Publk; school and nonpublk: school teachers were asked to 
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Tables 

Number of Parents and Total Number of Contacts Reported for 
Parent Involvement Activities for the Public and Nonpublic 
Schools in the Chapter 1 Reading Program 
1992-93 







Totals for Year 




Program Activities 


1 r6atnri6nt 
Group Pupils* 
(N=1941) 


All rUpilS 

Seived 
{N=5956) 


1. 


Parents involved in the planning, operation 
and/or evaluation of your unit 

Kliimhuar of ParAnlQ 

NunDber of Contacts 


203 
577 


638 
1683 


2. 


Group meetings for parents 
Number of Parents 
Number of Contacts 


697 
898 


1447 
1794 


3. 


Individual parent conferences 
Number of Parents 
NumDer oi womacis 


2024 
3678 


5273 
9285 


4. 


Parental classroom visits or field trips 
Number of Parents 
Number of Contacts 


480 
637 


1093 
1392 


5. 


Visits by teacher to parents* homes 
Number of Parents 
Number of Contacts 


50 
59 


127 
158 




Total Parents Contacted'^ 
Total Number of Contacts 


2212 
5849 


5779 
14312 



^ Treatment Group Pupils are those who attended the program at least 80 percent of the 
instaictional period or who were discontinued from the program. 

b Total Parents Contacted is based on an unduplicated count of parents contacted, which is less 
than the sum obtained when combining the Number of Parents for Activities 1-5. 
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send a random sample of these records to their Program Evaluator in November 1992, and again in 
Febmary 1993. After each teacher's records were reviewed, teachers v/ere scheduled, as needed, for 
telephone conferences; problems were discussed and amefiorated. 

On-site visitations. During December 1992 - January 1993, Program Evaluators conducted on-site 
school visitations to all program teachers to verify ihat the Chapter 1 Consulting Teachers and the 
Nonpublic Program teachers were using 1) appropriate pupil selection procedures 2) had an up-to-date list 
of books read for each pupil, 3) had a current class schedule posted, 4) had identified and completed the 
appropriate fonns for a student in Student Program Improvement, and 5) had verifiable evidence of 
biweekly coordinatk)n with classroom teachers. To facilitate this evaluatton activity, the city was divkled 
into geographical areas. Within each geographical area all project teachers in the program were visited by 
a Program E valuator-regard less of whether the project units were reading or mathematics, public or 
nonpublic. 

Selection lists were reviewed. The pupils served, as well as the pupils on the waiting lists in each 
subject area, were ascertained. Overall, appropriate pupils were selected. When there were irregularities, 
the problems stemmed from scheduling conflicts or mobility at the middle school level or personal 
annotation systems other than the system advised by the Departnoent of Program Evaluation at the 
elementary level. 

Records of books being read were generally up-to-date but were in various stages of being 
transfen-ed from a given teacher's personal records to a more formal one. Schedules were generally 
updated or in process of being updated by all teachers. Student Program Improvement students were all 
identified with the teachers' having written the students' instmclional plans or in the process of completing 
them. Lastly, evidence of coordination of instaiction was evident in almost every teacher's lesson plan 
book. At the elen^ntary level it was astonishing to discover that teachers were coordinating with as many 
as 12 different classroom teachers. Coordinatton plans were more sketchy at the middle school level 
because of scheduling and lack of common time with classroom teachers, e.g. lunch, before school, after 
school, conference times, or because they were out of synchronizatfon with the classroom teachers' study 
units. 



Summary 

The purpose of the Chapter 1 Reading Program was to provide assistance to selected underachieving 
pupils in grades one through eight in order that they might attain more fully their potential by improving their 
language and reading skills. The program featured small group instmctfon arranged according to pupil 
needs, as determined by continued cooperation between the program teacher and the classroom teacher. 
Insen/ice sessk)ns were provided for various subgroups of program teachers. 

A total of 5956 pupils was sen/ed by the Chapter 1 Reading Program during the 1992-93 school year. 
Average daily membership in the overall program was 4653.35 The average days scheduled (enrolled) per 
pupil was 1 03.4, and the average days served (attended) per pupil was 85.4. The program was staffed with 
166 teachers sen/ing 113 public schools, and 12 nonpublk; Chapter 1 eligible schools in 172 program units. 
Of the 5956 pupils sen/ed, 3864 pupils were served by 109 teachers in the elementary public school 
project, 1855 pupils were sen/ed by 48 teachers in the public middle school project, and 237 pupils were 
sen/ed by 9 teachers in the nonpublic school project. 

Pretest/posttest analyses included two evaluation samples. Nomvreferenced *Qst results for Reading 
Comprehensk)n were reported for grades 2-8 as required in Desired Outcome 1. In addttton. Federal and 
State Guidelines required that aggregate test data be reported for grades 2 and above for both Reading 
Comprehenston and Total Reading for indivklual buiWings. Consequently, Total Reading test data were 
also reported. Program pupils were included in either or both of the samples. Both evaluation samples 
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were comprised of pupils who met their project attendance criteria, were English-speaking, and had a 
Reading Comprehension and/or a Total Reading pretest and posttest score. Some pupils might have met 
the criteria for only one evaluation sample. 

In regard to aggregate test results to rrieet Federal and State Gukleiines, aggregate achievement 
scores for individual buildings were reported to the State of Ohio Departnwnt of Education, Division of 
Federal Assistance, and are available upon request. For puiposes of this report, only the grade and total 
program NCE scores wore reported. The overall iiverage NCE change for the program was 6.3 in Reading 
Comprehension and 4.9 in Total Reading. It should be kept in mind that these were aggregate scores for 
the district. Indivklua! buiWings were expected to show an aggregate gain of 1 .0 NCE or more according to 
State Guidelines. 

The program had three Desired Outcomes. Rndings for these Desired Outcomes are summarized in 
Tables 10 and 11. 

The criterion for performance for Desired Outcome 1 was that at least 50 percent of the pupils in the 
sanpie would gain at least 3.0 normal cun^e equivalent (NCE) points for the instructional period in Reading 
Comprehenston. Table 10 gives summary data for pupils in the evaluation sample, with the percent of 
pupils meeting the criterion for Desired Outconne 1. The number of pupils in the evaluatton sample for 
Reading Comprehension shows that of the 1896 pupils in the evaluation sample, 1111 pupils (58.6%) met 
the criterion for Reading Comprehensfon. 

Desired Outcome 2 stated that 75 percent of pupils in the treatment group woukJ demonstrate 
satisfactory progress in the regular classroom by promotk)n to the next grade (grades 1 -5) or by passing the 
course in which reading instaictfon occurs (grades 6*8). The criterion was met in every project at eveiy 
level wHh 1755 pupils (92.6%) of the 1896 pupils in the treatment group either being promoted or passing 
their courses. For results by grade see Table 1 1 . 

Desired Outcome 3 stated that of the grade 1 pupils in the treatnrient group, at least 50 percent of the 
pupils will read at leas^ five books at level 8 or above as certified by the Chapter 1 teacher. At least 50 
percent of the pupils in grades 2 and above in the treatment group who were not discontinued, will 
independently read a minimum of ten books selected by the Chapter 1 teacher. In grade 1 , there were 66 
pupils in the treatment group. Of these pupils, 57 (86.4%) successfully read the appropriate level and 
number of books. In grade 2 and above, 1843 pupils were in the treatment group. Of these pupils 1500 
(81 .4%) independently re^d the minimum number of ten books. For results by grade see Table 1 1 . 

The results from the monitoring of parent involvement showed that parents of 77.4 percent of the 
pupils served partrcipated in designated Chapter 1 Reading Program activities. Teachers reported contact 
with parents for specified activities. They reported an unduplk^ated total of 5779 parents of pupils sensed 
who were involved in one or more activities. 

Process evaluatton was conducted to monitor the record-keeping procedures, classroom 
management, and classroom activities of teachers. Telephone conferences and on-site visrtattons were 
instrumental in assuring that program guidelines were being followed. 



Recommendattons 

The foltowing recommendations are made to strengthen the 1993-94 Chapter 1 Reading Program: 

1 . Since the program was highly successful in achieving each of its Desired Outcorros, it is strongly 
recommended that the program be continued. 
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2. Of the 5956 pupils served In grades 1-8, only 1941 (32.6%) met criterion to be Included in any 
treatment group, i.e. attended 80 percent of time. Ways to Improve attendance need to be 
studied. 

3. Federal and State Program personnel should continue to provide supervision through insen/ice 
and school visitations to maintain the feeling among program teachers of having a strong support 
system. 

4. The Department of Program Evaluatton should continue monitoring of record keeping and data 
collection. This has been heipful In assuring the validity of data collected. 

5. Administrators and staff should develop a plan to Insure that joint planning with program teachers 
Is occurring. Teacher schedules and iocatbns in a building have sometimes acted as 
constraints to more frequent and formal joint planning particularly at the middle school level. 
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Footnote 



^One nonpublic school differed from other nonpublic schools sefved by the program in that (1) it was 
not a church-operated school, and (2) it sen/ed only pupils with leaming disabilities and/or behavior 
disorders. Because it was not a church-operated school, program instmction was provided in the school 
building instead of in a mobile classroom unit. Also, there were no norm-referenced pretest data from the 
previous year because of the students* eligibility for special education. Therefore norm-referenced test data 
from this school were not included in the overall findings. 
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SCHOOL CODE 



PUPIL DATA SHE^T 
PROGRAM CODE 9 3 0 14 SSN 



SCHOOL NAME 
1 . STUDENT NAME 



PROGRAM NAME 



TEACHER NAME 





1 ast 




f 1 rst 


2 . 


STUDENT NO . GRADE 


D X K 1 nu A 1 b 


/ 










3. 


AVERAGE HOURS PER WEEK OF INSTRUCTION 














4 . 


PUPIL PROGRESS 


NONE 


SOME 


5. 


IS THIS PUPIL ENGLISH SPEAKING? 


NO 


YES 


6. 


WAS THIS PUPIL DISCONTINUED? 


NO 


YES 




(CAREFULLY READ GUIDELINES) 






7 , 


PARENT HELPED WITH HOMEWORK? 


NO 


YES 


8 . 


PARENT READS TO CHILD OR CHILD READS 


. NO 


YES 




TO PARENT? 







MUCH 



FOR NUMBERS 9-13. FILL IN THE NUMBER OF THIS PUPIL'S PARENTS INVOLVED 
IN EACH ACTIVITY DURING THE YEAR AND TOTAL NUMBER OF CONTACTS. 



NO. OF PARENTS 



10. 



PLANNING 



GROUP MEETINGS 



11. INDIVIDUAL CONFERENCES 



12. 



13. 



CLASSROOM VISITS 



HOME VISITS 



TOTAL NO. OF CONTACTS 



14. NUMBER OF DAYS SERVICE SCHEDULED 
(CAREFULLY READ INSTRUCTIONS) 



FROM 03-29-93 
THRU 03-26-93 THRU 05-07-93 

+ 4.-,,----4. 



15. NUMBER OF DAYS SERVICE RECEIVED 
(CAREFULLY READ INSTRUCTIONS) 



16. WHILE IN YOUR CLASS, the Number 
of Sel acted Books Read 



17. ON AVERAGE. THIS PUPIL WAS 
SCHEDULED TO RECEIVE SERVICE 



DAYS OUT OF 



EKLC 



53 



Prepared by 
Office of the Superintendent 
Department of Program Evaluation (pif pds) 
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ESEA - Chapter 1 
Parent Involvement Log 
1992-93 



Program Code 



Name of Pupil 



Grade 



Parent Name Address Phone Number 

THE COLLECTION OF PARENT INVOLVEMENT DATA IS REQUIRED BY CHAPTER 1. 

Please check if the following two activities occurred for this pupil anytime this year. 



B 



Parent helped child with homework 
Parent read to child or child read to parent 



DIRECTIONS: Please indicate In the fields below the date, activity, name of parent/guardian, and th o Xkno 
(Houro) you opont with tho paront(c). ROUND HOURS TO THE NEAREST TENTH. 
Obviously, you may keep expanded notes about activities somewhere else. 



Date 

MMDDYY 



Activity* 
(1-5) 



Attendee(s) 
Parent/Guardian 



H oufiG 



•Kinds of Parent Involvement to record for the column labeled Activitv 

(1 ) Involved in planning (do not include advisory council) 

(2) Group meetings (do not include advisory council) 

(3) Individual conferences (telephone conferences included) 

(4) Parental classroom visits 

(5) Home visits 



Revised 02/18/93 



5b 
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GENERAL INSERVICE EVALUATION FORM 
1992-93 



Insen/ice Topic: 
Presenter(s): 



Date: 



/ 



/ 



. (e.g.. 03/05/93) 



MM DD YY 
Session (Check only one): 



_all day 



a.m. 



j}.m. 



after school 



Circle only the program(s) you are in: 

ESEA Chapter 1 Progranfis: 

(1) Reading Elementary (1-5) 

(2) Mathematics-Elementary (3-5) 

(3) Reading-Middle School (6-8) 

(4) Mathematics-Middle School (6-8) 

(5) N or D (1-12) 

(6) Nonpublic (1-8) 

(7) Reading Recovery (1) 

(8) Early Literacy (1-2) 



DPPF Programs: 

(9) Instmctional Assistant - K 

(10) ADK 

(11) Early Literacy - 2 

General Fund Program: 

(12) HSCA/SSS 

aher (Specify) 

(13) 



Circle the number that indicates the extent to which you agree or disagree with statements 1-4. 



Strongly 
Aqr^^ 



1. 

2. 

3. 

4. 
5. 



I think this was a very worthwhile 
insen/ice. 

The information presented in this 
insen/ice will assist me in my program. 

There was time to ask questions 
pertaining to the presentations. 

Questions were answered adequately. 



Agrgfi- 
4 



3 



2 



5 

5 



4 
4 



3 
3 



2 
2 



What was the most valuable part of this meeting? 



Strongly 
1 



6. What was the least v aluable part of this meeting? 



7. What additional infomnation or topics would you like to see covered in future meetings? 

a) 



b) 
c) 



P;\P502\FRPTRD93 ? 
6-1-94 6-1-94 



ERLC 



3S 



Date of Orientation Meeting . 



ESEA CHAPTER 1 AND DPPF 
ORIENTATION INSERVICE EVALUATION FORM 
1992-93 ORIENTATION 

■ ^A.M. 



P.M. ALL DAY 



Circle only the program(s) you are in: 

ESEA Chapter 1 Programs: 

(1) Reading Elementary (1-5) 

(2) Mathematics-Elementary (3-5) 

(3) Reading-Middle School (6-8) 

(4) Mathematics-Middle School (6-8) 

(5) NorD(M2) 

(6) Nonpublic (1-8) 

(7) Reading Recovery (1) 

(8) Early Literacy (1-2) 



DPPF Programs: 

(9) Instruotional Assistant - K 

(10) ADK 

(11) Early Literacy - 2 

General Fund Program: 

(12) HSCA/SSS 

Other (Specify) 

(13) 



Circle the number that indicates the extent to which you agree with statements 1 -4, in rating the overall day 
of inservice. 



Strongly 
Agree 



1 . I think this was a very worthwhile 
inservice. 

2. The information presented in this 
inservice will assist me in my program. 

3 . There was time to ask questions 
pertaining to the presentations. 

4. Questions were answered adequately. 



A q r gQ 
4 



Und^idod 
3 



Di$agr^ 

2 



Strongly 
Disagree 

1 



5 
5 



4 
4 



3 
3 



2 
2 



Circle the number that indicates how you would rate each of the foltowing porttons of today's inservtoe in 
regard to interest and usefulness of presentations. 



Superior Excellent Good 



6. 



Program Coordinators* Presentation 

a. Interest 

b. Usefulness 

c. Clarity of instructtons 
Evaluation Presentation 

a. interest 

b. Usefulness 

c. Clarity of instructions 



5 
5 
5 

5 
5 

5 



4 
4 
4 

4 
4 
4 



3 
3 
3 

3 
3 
3 



£ai£ 

2 
2 
2 

2 
2 
2 



Poor 

1 
1 
1 

1 
1 
1 



I Please turn over for questions 7-9 | 
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7. What was the most valuable part of this meeting? 



8. What was the least vaiuabie part of this meeting? . 



9. What additional infomiation or topics would you'like to see covered in future meetings? 
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